Computer network read-ahead caching method

ABSTRACT

A computer network read-ahead caching method for servers and clients includes compiling a list of addresses associated with the links on a page. The addresses are ordered on the list according to the likelihood that they may be visited by a user. Different compiling methods are provided, including compiling in the order the links appear on the page, compiling only the links which are currently displayed to the user, and compiling currently displayed links and links in the direction the page is being scrolled. Requests are send out to the addresses which are not in a local cache. Any cacheable pages which are received are cached. If the page for the selected link is already cached, it is fetched from the cache and displayed almost instantly, so that the user does not experience the download delay. If the page is not cached, a request is sent out. In another embodiment, the requests identify the client as a read-ahead caching client, and the responses identify the server as a compatible server. Under predetermined conditions, the server sends a regulating response to the client to regulate its read-ahead caching. The client may comply with the regulating response if the server is a compatible server, otherwise the client may ignore the regulating response.

CROSS REFERENCE TO RELATED APPLICATIONS

I claim the benefit of a prior divisional application with Ser. No.09/120,951 which was filed on Jul. 22, 1998, now U.S. Pat. No.6,249,804.

BACKGROUND OF THE INVENTION

1. Field of the Invention

This invention relates generally to the caching of Internet pages.

2. Prior Art

Information on the Internet is represented by files stored in computersrunning programs called servers, and is accessed by users with computersrunning computer programs called clients. The Internet includes severaldifferent services, the most popular being the World Wide Web, which isoften simply referred to as the Web. Information on the Web is providedby Web servers. A client called a Web browser is usually used foraccessing the Web, but there are other tools that can be used. Many Webbrowsers can also access other services on the Internet, such as FTP(File Transfer Protocol) and Gopher.

Information on the Web are currently represented by specially formattedtext files called Web pages, each of which is a text document written inHTML (Hypertext Markup Language) or another language, such as XML, HDML,VRML, etc. Each page has a Web address called an URL (Universal ResourceLocator). A typical page also includes hyperlinks, which are eitherunderlined text or graphical images that point to the addresses of otherpages, so that when one is clicked or selected, a request will be sentout for the associated page. E.g., when the Products hyperlink in amerchant's home page is selected, a request is sent out by the client tothe address specified in the hyperlink, and the associated Web page isdownloaded and displayed, replacing the home page on the user's screenwith a new page showing the merchant's products. A hyperlink may simplybe referred to as a link.

Browsers or clients typically use a communication protocol called HTTP(Hypertext Transfer Protocol) to request pages from Web servers. HTTP isa request/response protocol. Through a connection established between aclient and a server, a request is send by the client to the server, anda response is provided by the server to the client. Due to the vastnessand complexity of the Internet, there are usually intermediaries betweenthe client and the origin server, which is the server that the requestis intended for. Typically, a request generated by a client is relayedto the origin server by one or more other servers, such as proxy serversand gateways. A proxy server is an intermediary program which acts as aserver for receiving requests from clients, and also as a client forforwarding the requests onto other servers. A gateway is also anintermediary, but it receives requests as if it is the origin server.Any server that only passes along a request is called tunnel. Manyservers store files that pass through them temporarily in a local storecalled a cache. Except for tunnels, a response to a request could bereturned by any intermediary server if the file being requested is inits cache.

A frustrating aspect of using the Internet is the long delays associatedwith downloading pages from the Web or other services. Therefore, acache is also typically implemented by a client. Whenever a page isreceived by the client, it is stored in the cache. Some pages arecacheable, i.e., they are identified as being allowed in the cacheaccording to various parameters, whereas other pages are not cacheable,After prolonged Internet use, the cache would be filled with a verylarge number of pages. When a page is requested by the client, such asby clicking on a link, a hit test is first performed on the cache, i.e.,the cache is checked for the presence of the page. If there is a hit andthe cache is valid (e.g.., not expired), the page is fetched from thecache, so that it is displayed almost instantly, and the user is sparedfrom downloading the page through the slow communication link. If thereis a hit with an invalid respond, there is no hit, or the client doesnot maintain a cache, a request is sent by the client to the originserver. When the request is received by an intermediary server, such asa proxy server, a hit test will be performed on its cache. If there is ahit with a valid response, the requested page is sent by theintermediary server to the client. The response is treated by the clientas if it is sent by the origin server, so that the request is fulfilled.If there is a hit with an invalid response (e.g., page has expired),there is no hit, or the intermediary server does not maintain a cache,the request is forward to another server. A cache has a finite capacityfor storing pages, so that older pages are constantly being replaced bymore recently received pages. Some pages show frequently updatedinformation, such as stock quotes or weather, so a code is included inthese pages to prevent them from being cached, i.e., they are notcacheable.

Any server between the client and the origin server, other than atunnel, that implements caching can respond to a request if its cachecan provide a valid response. When the requested file is found andpassed to the client, any server other than a tunnel may save a copy ofit into its cache if the page is cacheable. When a requested page isreceived by the client, it will be displayed and also saved to theclient's cache if it is cacheable. The client will wait for the user toselect another link or enter another address before generating anotherrequest.

Due to the vast number of pages available on the Web, a requested pageis not likely to be cached by the client or any server along theconnection, unless the page was recently visited by the user. Therefore,most of the time when a link is clicked and the associated page isrequested, the user has to wait for the page to be downloaded. Thedownloading time can typically range from several seconds to over aminute. Much of the Web surfing experience is thus comprised of a greatdeal of waiting for pages to be downloaded.

Most proxy servers implement a caching mechanism very similar to thatemployed by clients. Since a proxy server serves many clients, its cacheis usually very large and the caching scheme is elaborate. However, thebasic principle of a proxy's caching mechanism is the same, i.e., returna page to a client if there is a valid response from proxy's cache,otherwise forward the request to another server, and when the responseis received, save it in the cache and also forward it to the client.

When a user is reading a Web page with a client, the processor andcommunication modules are idle, and simply waiting for the user to clinkon another link. Such wasted processing and communicating capabilitiesare put to use by some products, such as a browser plug-in sold underthe trademark “NETACCELERATOR” by IMSI. When a user is reading a pageand not clicking on any link, the addresses specified by the links onthe page are automatically contacted and their associated pagesdownloaded into a cache by “NETACCELERATOR.” Because these pages aredownloaded while user is occupied with reading the displayed page, theirassociated downloading times are transparent to the user. Theoretically,when a link on the displayed page is eventually clicked by the user, theassociated page is already cached, so that it will be displayed almostinstantly, and the downloading time is not experienced by the user.However, many Web pages contain a large number of links. Caching all thepages associated with all the links can take many minutes or even hours,which may be much longer than the time spent by the user on the originalpage. As a result, the pages for some links may not yet be cached, sothat the user will still experience downloading time for such links. Noinformation is disclosed by IMSI about the particular order, if any,that the pages are downloaded. Therefore, its caching scheme may not bethe most efficient.

A product sold under the trademark “GOT IT!” by Go Ahead Software isalso a client plug-in for downloading pages associated with links on aWeb page. Another product sold under the trademark “GOT IT! ENTERPRISE”by Go Ahead Software is for downloading pages to local servers. Noinformation is disclosed by Go Ahead Software about the particularorder, if any, that the pages are downloaded by either product.Therefore, their caching schemes may not be the most efficient. Theseprior art read-ahead caching programs will initially benefit individualusers. However, if they are used by a large number of users, they canoverload the Internet with a hugely increased number of requests, sothat all users will end up suffering even greater delays.

OBJECTS OF THE INVENTION

Accordingly, several objects of the present computer network read-aheadcaching method are:

to enable a server and a client to cache pages associated with the linkson a Web page to reduce or eliminate the waiting time experience by auser when the links are accessed;

to order requests for the pages according to the likelihood that thepages may be requested by the user, so as to maximize the likelihoodthat a page will be in the cache when requested;

to cache pages specified by links on already cached pages, i.e., toperform multi-level read-ahead caching; and

to enable the server to regulate the read-ahead caching of the clientfor maximizing communicating efficiency.

Further objects of the present invention will become apparent from aconsideration of the drawings and ensuing description.

BRIEF SUMMARY OF THE INVENTION

A computer network read-ahead caching method for servers and clientsincludes compiling a list of addresses associated with the links on apage. The addresses are ordered on the list according to the likelihoodthat they may be visited by a user. Different compiling methods areprovided, including compiling in the order the links appear on the page,compiling only the links which are currently displayed to the user, andcompiling currently displayed links and links in the direction the pageis being scrolled. Requests are send out to the addresses which are notin a local cache. Any cacheable pages which are received are cached. Ifthe page for the selected link is already cached, it is fetched from thecache and displayed almost instantly, so that the user does notexperience the download delay. If the page is not cached, a request issent out. In another embodiment, the requests identify the client as aread-ahead caching client, and the responses identify the server as acompatible server. Under predetermined conditions, the server sends aregulating response to the client to regulate its read-ahead caching.The client may comply with the regulating response if the server is acompatible server, otherwise the client may ignore the regulatingresponse.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING

FIG. 1 is a flowchart of a first embodiment of the present computernetwork read-ahead caching method.

FIG. 2 is a flowchart of a second embodiment of the read-ahead cachingmethod.

FIG. 3 is a flowchart of a third embodiment of the read-ahead cachingmethod.

DETAILED DESCRIPTION OF THE INVENTION

FIG. 1:

As shown in the flowchart in FIG. 1, a first embodiment of the presentinvention is comprised of a client read-ahead caching system 10cooperating with a client 11. Client read-ahead caching system 10 may beprovided as a plug-in, i.e., an add-on program to client 11, or it maybe an integral part of client 11. As an example, client read-aheadcaching system 10 may be written as a Windows or Unix programrespectively running on an Intel-based personal computer or RISCworkstation.

After client 11 is started at block 12, an Internet page, e.g., a Webpage, is displayed at block 13 by entering or selecting a correspondingWeb address, although a default address may be used. The process islooped at block 14 until a link is selected by a user. If the addressfor the selected link is in a local cache and valid at block 15, theassociated page is fetched from the cache and displayed at block 13,replacing the previously displayed page. Any type of file with its ownInternet address, including HTML documents, executables, graphics, etc.,may be considered as a page in this invention. If the address is not inthe cache, a request for the page specified by the link is sent out atblock 16 by client 11. The process is looped at block 17 until therequested page is received. When the requested page is received, but itis identified as not cacheable at block 18, the received page isdisplayed at block 13 but not saved to cache. If the received page iscacheable at block 18, it is saved to cache at block 19, and displayedat block 13, replacing the previously displayed page.

Whenever a page is being received or has been received, clientread-ahead caching system 10 is started as soon as the processor andcommunication module become available or idle, such as when the user isreading the displayed page without selecting the links on it. A list ofthe address specified by the links, if any, on the displayed page iscomplied at block 20. Some pages include multiple links with the sameaddress, so duplicate addresses on the list are eliminated. Client 11and client read-ahead caching system 10 are preferably concurrently runby a suitable multitasking operating system, so that a page can bedisplayed and multiple other pages downloaded at the same time.

If a link on the displayed page is not selected at block 21, the list ischecked for whether there is any address on it at block 22. If noaddress is on the list, client read-ahead caching system 10 is ended atblock 33. If a link on the displayed page is not selected by the user atblock 23, an address on the list is selected by the system and removedfrom the list at block 24. If a link on the displayed page is notselected by the user at block 25, the address selected by the system ischeck for its presence in the local cache at block 26, i.e., a hit testis performed. If it is already in the cache, i.e., if there is a hit,the process is repeated from block 21 for the next address.

If the address is not in cache at block 26, a request is sent out atblock 27. The process is simultaneously repeated at block 21 for thenext address while the system is waiting to receive the requested page,i.e., requests are sent out in the sequence in which the addresses arecompiled on the list at the same time the pages are being downloaded.The process is looped at block 28 until the requested page is received.If the read-ahead caching request is rejected by the server at block 29,client read-ahead caching system 10 is ended at block 34, and is notrestarted in the remaining client session. If the read-ahead cachingrequest is not rejected at block 29, a link is not selected at block 30,and the page is cacheable at block 31, the page is saved to cache atblock 32, and client read-ahead caching system is ended at block 33. Ifthe page is not cacheable at block 31, the process is ended at block 33.If at any time during read-ahead caching a link on the displayed page isselected by the user at blocks 21, 23, 25, or 30, client read-aheadcaching system 10 is ended at block 33. When the next page is displayed,client read-ahead caching system 10 is started again for the newlydisplayed page. Alternatively, read-ahead caching may be continued fromwhere it was interrupted on the previous page, or continued at the linkfollowing the selected link on the previous page.

Requests are thus automatically sent to the addresses specified by thelinks on a displayed page, and the associated pages are transparentlydownloaded and saved to cache. When a link on the displayed page isselected by the user, the associated page for the selected link mayalready have been saved to cache, so the page may be fetched from thecache and displayed almost instantly. When a new page is displayed, theclient read-ahead caching system is restarted for it.

A code is preferably included in each request to identify it as aread-ahead caching request, so that a compatible server may handle therequest accordingly. E.g., the code may be included in the User Agentheader defined in the HTTP 1.1 protocol. The code may be readilyidentifiable to any conventional server, e.g., it may be the trademarkof the client. Alternatively, it may be identifiable only to acompatible server programmed to identify it, so that the read-aheadcaching request cannot be identified as such by incompatible servers,and the request is prevented from being rejected by incompatibleservers.

The addresses on a displayed page may be compiled on the list in theorder they appear on the page, e.g., from top to bottom in the HTML textfile. However, due to the limited interval between user initiatedrequests, not all the pages may be downloaded in time. Therefore, theaddresses on the list are preferably ordered according to the likelihoodthat the pages may be requested by the user, i.e., the pages for thelinks which are most likely to be selected by the user are requestedfirst, e.g., according to the following alternative systems:

1. Include only the addresses for the links which are displayed to theuser, e.g., when a large page is partially displayed.

2. Include only the addresses for the links which are displayed to theuser, and order those in the middle of the displayed area ahead of thosethat are farther away.

3. Include only the addresses for the links which are displayed to theuser, and also the addresses for the links in an area adjacent to thedisplayed area. The adjacent area is above the displayed area when theuser is scrolling up or has recently scrolled up. The adjacent area isbelow the displayed area when the user is scrolling down or has recentlyscrolled down.

The adjacent area is below the displayed area when the very top of thepage is displayed. The adjacent area is above the displayed area whenthe very bottom of the page is displayed.

After read-ahead caching for the displayed page is finished and theprocessor and communication module are available, multilevel read-aheadcaching may be performed on other pages. Alternative multilevelread-ahead caching systems may comprise sending requests to theaddresses on the cached pages which are not displayed, or sendingrequests to the addresses on previously displayed pages.

FIG. 2:

As shown in the flowchart in FIG. 2, a second embodiment of the presentinvention is comprised of a server read-ahead caching system 40cooperating with a server 41, which in this example is a proxy server,but may be any other type of server. Server read-ahead caching system 40may be provided as a plug-in, or it may be an integral part of server41.

After starting at block 42, the process is looped at block 43 until arequest is received from a client. If the requested page is in a localcache at block 44, the page is sent to the client at block 49, andserver read-ahead caching system 40 is simultaneously started for thepage. If the requested page is not in the server's local cache at block44, the request is forwarded to another server at block 45. The processis looped at block 46 until the page is received. If the received pageis not cacheable at block 47, it is sent to the client at block 49, andserver read-ahead caching system 40 is simultaneously started for thepage. If the received page is cacheable at block 47, the page is savedto cache at block 48, sent to the client at block 49, and serverread-ahead caching system 40 is simultaneously started for the page. Theprocess is ended at block 50.

Whenever server read-ahead caching system 40 is started, a list of theaddresses on the forwarded page is compiled at block 51. Some pagesinclude multiple links with the same address, so duplicate addresses onthe list are eliminated. If there is no address on the list, i.e., thereis no link on the displayed page, server read-ahead caching system 40 isended at block 59.

If there is one or more addresses on the list, an address on the list isselected and removed at block 53. If the selected address is in cacheand valid at block 54, the process is returned to block 52, and the nextaddress, if any, on the list is selected. If the selected address is notin cache at block 54, a request is send out for the page at block 55,and the process is simultaneously returned to block 52 for the nextaddress, if any. The process is looped at block 56 until the requestedpage is received. If the received page is not cacheable at block 57, theprocess is ended at block 59. If the received page is cacheable at block57, it is saved to cache at block 58, and the process is ended at block59.

After the client initiated request at block 43 is responded to by server41, server read-ahead caching is begun as soon as the processor andcommunication module are available. Pages received through serverread-ahead caching is saved in the server's cache, but not forward toother computers. When another client initiated request is received, therequested page might already be saved in cache. If the client isconnected to server 41 through a high speed network, such as in atypical office environment, the cached page will be supplied to theclient very quickly. If the requested page is not in cache, a request issent out by server 41 to other servers. If a new client initiatedrequest is received while server read-ahead caching is being performed,server read-ahead caching is preferably suspended and the new request ishandled. After the new page is forwarded to the client, serverread-ahead caching may be resumed from where read-ahead caching on theprevious page was interrupted, or at the link following the selectedlink on the previous page.

After read-ahead caching for the forwarded page is finished and theprocessor and communication module are available, multilevel read-aheadcaching may be performed on other pages. Alternative multilevelread-ahead caching systems may comprise sending requests to theaddresses on all cached pages, or sending requests to the addresses onread-ahead cached pages.

FIG.3:

As shown in the flowchart in FIG. 3, a third embodiment of the presentinvention is comprised of a server read-ahead caching system 60 whichincludes a server 61. After starting at block 62, the process is loopedat block 63 until a request is received. If the requested page is in theserver's local cache at block 64, the page is sent to the client atblock 72, and server read-ahead caching is started for the page at block74. If the requested page is not in the local cache at block 64, and therequest is not identified as a read-ahead caching request at block 65,the request is forwarded at block 67. If the request is identified as aread-ahead caching request at block 65, server 61 may determine whetherto allow read-ahead caching by the client at block 66 according to anydesired parameter, such as the server's available bandwidth. If theread-ahead caching request is allowed at block 66, it is forwarded toother servers at block 67, otherwise a regulating response is generatedand sent to the client at block 71.

If the request is forwarded at block 67, the process is looped at block68 until the page is received. If the received page is not cacheable atblock 69, it is sent to the client at block 72, and server read-aheadcaching is started for the page at block 74. If the received page iscacheable at block 69, the page is saved to cache at block 70, sent tothe client at block 72, and server read-ahead caching is simultaneouslystarted for the page at block 74. The server process is ended at block73.

The regulating response may be provided in any suitable form, e.g., as acode in the Respond Server header defined in the HTTP 1.1 protocol. Theregulating response may include any instruction for regulating theactions of the client, including the following different instructions:

1. Informing the client that read-ahead caching is not allowed by theserver.

2. Instructing the client to stop read-ahead caching.

3. Informing the client that it may start read-ahead caching.

4. Instructing the client to delay read-ahead caching until after aspecified time delay.

5. Informing the client that one or more previous requests of the clientwere ignored by the server.

6. Informing the client that read-ahead caching requests for pages inpredetermined categories, such as certain Webs sites, are ignored or notallowed.

7. Informing the client the status of the server such as its activity(how busy), bandwidth, communication properties, etc.

8. Instructing the client to limit the number of requests or number ofoutstanding requests.

9. Instructing the client to limit the number of requests or number ofoutstanding requests in a specified time interval.

Further, a code may be included in the regulating response identifyingthe server as a compatible server. The client may be programmed tocooperate with a compatible server. If the regulating response isgenerated by a non-compatible server, the client may be programmed toignore the regulating response and continue read-ahead caching.

Whenever server read-ahead caching is started, a list of the addresseson the forwarded page is compiled at block 74. Some pages includemultiple links with the same address, so duplicate addresses on the listare eliminated. If there is no address on the list, i.e., there is nolink on the displayed page, server read-ahead caching is ended at block82. If there is one or more addresses on the list, an address on thelist is selected and removed at block 76. If the selected address is incache and valid at block 77, the process is returned to block 75, andthe next address, if any, on the list is selected. If the selectedaddress is not in cache at block 77, the request is forwarded at block78, and the process is simultaneously returned to block 75 for the nextaddress, if any. The process is looped at block 79 until the requestedpage is received. If the received page is not cacheable at block 80, theread-ahead caching process is ended at block 82. If the received page iscacheable at block 80, it is saved to cache at block 81, and the processis ended at block 82.

SUMMARY AND SCOPE

Accordingly, a computer network read-ahead caching method is provided.It enables servers and clients to cache pages associated with links on aWeb page to reduce or eliminate the waiting time experience by a userwhen the links are accessed. It orders requests for the pages accordingto the likelihood that the pages may be requested by the user, so as tomaximize the likelihood that a page may be in the cache when requested.It caches pages specified by links on already cached pages, i.e., itperforms multi-level read-ahead caching. It also enables the server toregulate the read-ahead caching of the client.

Although the above description is specific, it should not be consideredas a limitation on the scope of the invention, but only as an example ofthe preferred embodiment. Many substitutes and variations are possiblewithin the teachings of the invention. For example, the read-aheadcaching method can be written in any suitable computer language for anysuitable operating system and any hardware platform. It may be a programseparate from others, or it can be an integral part of other programs.It can be applied to any Internet service that can use caching,including but not limited to the World Wide Web, FTP (File TransferProtocol), Gopher, etc. It can also be applied to any other type ofcomputer network in addition to the Internet. Therefore, the scope ofthe invention should be determined by the appended claims and theirlegal equivalents, not by the examples given.

I claim:
 1. A computer network server read-ahead caching method,comprising: receiving a read-ahead caching request from a client;fulfilling said read-ahead caching request when a predeterminedcondition is met; and sending a regulating response to said clientregulating read-ahead caching operation of said client when saidpredetermined condition is not met.
 2. The computer network serverread-ahead caching method of claim 1, further including informing saidclient in said regulating response that said read-ahead cachingoperation is disallowed by said server.
 3. The computer network serverread-ahead caching method of claim 1, further including instructing saidclient in said regulating response to stop said read-ahead cachingoperation.
 4. The computer network server read-ahead caching method ofclaim 1, further including instructing said client in said regulatingresponse to begin said read-ahead caching operation.
 5. The computernetwork server read-ahead caching method of claim 1, further includinginstructing said client in said regulating response to delay saidread-ahead caching operation until after a specified time delay.
 6. Thecomputer network server read-ahead caching method of claim 1, furtherincluding informing said client in said regulating response that aprevious read-ahead caching request of said client was ignored by saidserver.
 7. The computer network server read-ahead caching method ofclaim 1, further including instructing said client in said regulatingresponse that any read-ahead caching request for information in apredetermined category is disallowed.
 8. The computer network serverread-ahead caching method of claim 1, further including informing saidclient in said regulating response of a communication status of saidserver.
 9. The computer network server read-ahead caching method ofclaim 1, further including informing said client in said regulatingresponse of a maximum allowable number of read-ahead caching requests.10. The computer network server read-ahead caching method of claim 1,further including informing said client in said regulating response of amaximum allowable number of read-ahead caching requests in a specifiedtime interval.
 11. A computer network read-ahead caching method,comprising: providing a client; sending a request with said client;identifying said client in said request as a read-ahead caching client;providing a server; receiving said request with said server; fulfillingsaid request with said server when a predetermined condition is met;sending a regulating response to said client with said server when saidpredetermined condition is not met, said regulating response regulatingread-ahead caching operation of said client; and identifying said serverin said regulating response as a compatible server, said clientcooperating with a response from any server identified as saidcompatible server to maximize communication efficiency, said client notcooperating with said response from any server not identified as saidcompatible server so as to continue with said read-ahead cachingoperation.
 12. The computer network read-ahead caching method of claim11, further including instructing said client in said regulatingresponse to stop said read-ahead caching operation.
 13. The computernetwork read-ahead caching method of claim 11, further includinginstructing said client in said regulating response to delay saidread-ahead caching operation until after a specified time delay.
 14. Thecomputer network read-ahead caching method of claim 11, furtherincluding instructing said client in said regulating response that anyread-ahead caching request for information in a predetermined categoryis disallowed.
 15. The computer network read-ahead caching method ofclaim 11, further including informing said client in said regulatingresponse of a maximum allowable number of read-ahead caching requests.16. The computer network read-ahead caching method of claim 11, furtherincluding informing said client in said regulating response of a maximumallowable number of read-ahead caching requests in a specified timeinterval.